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ABSTRACT 

/ 

\ 

We  consider  the  choice  of  technique  in  a  continuous  time  infinite 
horizon  optimal  growth  model.  There  are  n  +  2  goods,  output,  labor 

and  machines  . ...  M'  .  We  can  convert  one  unit  of  labor  to 

r 

q  units  of  output  or  r^  units  of  ty  ,  for  each  i  .  Also,  we  can 
convert  one  unit  of  labor  and  one  unit  of  to  q^  units  of  output. 

We  prove  under  some  sufficient  and  necessary  conditions  that  we  never 
build  any  machines  for  the  general  concave  utility  function.  If  the 
condition  is  not  met,  we  build  one  machine  from  beginning  to  end  when 
the  utility  function  is  linear;  when  the  utility  function  is  non¬ 
linear  life  gets  complicated.  In  the  one  machine  case,  we  give  a 
general  algorithm  to  solve  it.  In  the  many  machines  case,  we  prove 
an  asymptotic  result  (as  t  -*■  00  ,  the  behavior  is  similar  to  that  of 
the  linear  case)  and  give  examples  showing  that  a  simple  characteriza¬ 
tion  of  the  optimal  solution  is  difficult.  , 
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CHAPTER  I 


MODEL  AND  DISCUSSION 


il.  Introduction 


In  this  paper  we  investigate  the  choice  of  investment  in  a  con¬ 
tinuous  time  optimal  growth  model.  The  general  model  is  described 
as  follows:  there  are  m  goods,  some  of  which  may  be  provided 
exogenously  (e.g.  labor).  The  technology  is  described  by  a  set  of  n 
activities,  each  of  which  consumes  various  amounts  of  goods  and  produces 
various  amounts  of  goods.  To  be  more  specific,  the  technology  is 
given  by  a  pair  of  nonnegative  m  *  n  matrices  A  B  and  a  nonnegative 
n-vector  b  ,  where  denotes  the  amount  of  good  i  used 

(produced)  to  operate  activity  j  at  unit  level,  and  b^(t)  denotes 
the  amount  of  good  i  exogenously  provided  at  time  t  .  There  is  a 
utility  function  which  is  an  increasing  concave  function  of  the  activity 
level. 


Problem: 

Given  b(t)  ,  find  an  activity  vector  x(t)  to  maximize  the  dis¬ 
counted  integral  of  future  utility. 

We  can  write  this  as  a  continuous  programming  problem: 


<P> 


Maximize 


j  e  C't,U(x(t))dt 

*0 


subject  to:  A*x(t)  <  I  B*x(s)ds  +  b(t) 


l 


x(t)  >  0  . 


f  Bail  in  iTiiiTi 


2 


If  x(t)  is  <P>  feasible  |x(t)  >  0  ,  Ax(t)  <  J  Bx(s)ds  +  b(t)j 
then  we  have  the  following  dual  problem: 


<D(x(t))>:  Minimize 


00 

w(t)  • 


b(t)dt 


00 

/“< 


subject  to:  w(t)A  >  J  w(s)Bds  +  e  at*VU(x(t)) 

t 


w(t)  >  0  . 


§2.  Optimality  Theorem  for  the  General  Model 

In  this  section  we  prove  that  a  feasible  solution  (x(t))  is 
optimal  if  we  can  find  the  corresponding  dual  price  (w(t))  and  satisfy 
some  complementary  slackness  conditions. 


Theorem  1-1: 

If  the  following  four  conditions  are  satisfied 


(1) 

(2) 

(3) 

(A) 


x(t)  is  <P>  feasible  I i.e.,  Ax(t)  <  f  B-x(s)ds  +  b(t)  , 

\  '  =  0 

x (t)  >  0)  . 

D(x(t))>  feasible  |i.e.,  w(t)A  >  f  w(s)Bds  + 

\  ’  t 


w(t)  is  < 
-at 


VU(x(t) )  ,  w(t)  >  0 


) 


w(t)|^Ax(t)  -/  B*x(s)ds  -b(t)^  =  0 
^(t)  A  -  J*  w 


(s)Bds-e  *VU(x(t))  *x(t) 


i  ■ 


then  x(t)  is  <P>  optimal,  w(t)  is  <D(x(t))>  optimal. 
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Proof : 


Let  x(t)  be  any  (P)  feasible  solution 

w(t)  be  any  (D(x(t))>  feasible  solution. 


w(t) *b  ( 


■*  ^ 

t)  >  w(t) •  A-x(t)  -j*  B-x 


(s)ds 


Integrating  both  sides  gives 


w(t)-b(t)dt  >  j w(t)-|Ax(t)  -  J*B-x(s)ds|dt 

J”°  OO  “ 

w(t)A  -  I  w(s)Bds  • 

u  L  *t 


w(s)Bds  I *x(t)dt  (changing  the  order  of 
integral) 


>  I  e  *VU(x(t))*x(t)dt  (w(t)  is  ( D )  feasible) 


>  I  e  [VU (x(t) ) *x(t)  +  U(x(t) )  -  U(x(t) ) ]dt 


°0  05 

J  e~at-U(x(t))dt  +  j e_at[VU(x(t)).£(t)  -  U(x(t))]dt 


e  -U(x(t))dt  +  M  . 


So  for  any  x(t)  ,  w(t) 


w(t) • b(t)dt  >  I  e~at*U(x(t))dt  +  M 


but  if  we  replace  x(t)  ,  w(t)  by  x(t)  ,  w(t)  then  the  above  ">" 
are  replaced  by  "="  (from  (3)  and  (4))  thus 


CO 


l 


w(t)*b(t)dt  =  I  e  at *U(x(t) )dt  +  M 

'0  i 


From  (5)  and  (6) 


00 

I 

GO 


w(t)*b(t)dt  reaches  the  lower  bound  and 


e  at*U(x(t) )dt  reaches  the  upper  bound. 


So  w(t)  is  <P)  optimal 

w(t)  is  <D(x(t))>  optimal  ■ 

§3.  Description  of  the  Investment  Model 

We  now  consider  the  special  case  as  follows: 


(1)  There  are  n  +  2  goods,  output  (consumption),  labor,  and 

n  machines  M  ,M  ,  ...,  M 
1  L  n 

(2)  There  are  n  +  1  production  activities  P  ,P  ,  ...,  P 

0  1  n 

Pg  converts  one  unit  of  labor  to  q  units  of  output. 

P,  converts  one  unit  of  labor  and  one  unit  of  M,  to  q. 
i  i  i 

units  of  output  1  <  i  <  n  . 

(3)  There  are  n  investment  activities  1  ,IoJ  ...,  I  ,  where 

12  n 

1^  converts  one  unit  of  labor  to  r ^  units  of  1  <  j 

(4)  Labor  is  given  exogenously  at  constant  rate  of  one. 


Let  x  be  the  amount  of  labor  allocated  to  Pq  ; 


z  be  the  amount  of  labor  allocated  to  P .  1  <  i  <  n  ; 

i  1 

y  be  the  amount  of  labor  allocated  to  I.  1  £  i  1  n  . 

i  x  -  - 

Let  a  be  the  discount  rate  and  U  be  a  differentiable  increasing 
utility  function  of  the  output. 

n 

We  define  c(t)  =  q*x(t)  +  l  q  -z  (t)  and  ip(t)  =  U'(c(t))  . 

i=l  1 


Problem: 


Given  initial  stocks  of  ,  choose  X(t)  -  (x(t),z^(t), 


yi(t))  g  m^n+1  to 


I 


-at 


maximize  I  e  *U(c(t))dt 

*0 


subject  to:  z 


i(t)  i  riJ  yi 


(s)ds  +  1  <  i  <  n 


n 


x(t)  +  l  (y .  (t)  +  z  (t))  <  1 
i=l  1 


By  defining  U(X(t))  =  U(c(t))  ,  VU(X(t))  =  (q,q^,  . .  •  ,  qn .  0,  •  •  •  »  0)  •  v'(t) 

n  terms 


_  2n+l  , 
G  ]R+  and 


o  j  ; 

0 

!  ri 

• 

i  r.  0 

3 

:  |  I  |  o 

,  B  = 

. 

o  !  2-. 

0  1  1 

J  _1  - 

0 

!  0  *rn 

111,  ...»  Ill,  ...»  1 

0 

o,  . . . ,  o  !  o,  . . . ,  o 

A  .  B  G  m(n+l)x(2n+l)  b(t)  .  (k . k  ,1)  ,  b(t)  G 


n+1 

“X 
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The  dual  problem  becomes: 


n+1 


Find  w(t)  =  (w  (t),  ....  w  (t),w(t))  £  IR,  to 
in  + 


00 

1 


minimize  I  w(t)*b(t)dt 
u 

—ct  t 

subject  to:  w(t)  >  e  *q-i|)(t) 


d ^ ( t >  =  w(t)  -  r.  |  w.  (s)ds  >  0 


00 

I  w. ( 
X)  1 


1  <  i  <  n 


-»ct  t 

w(t)  +  w^(t)  >  e  *q^*ij)(t) 


1  <  i  <  n 


If  the  utility  function  is  linear,  by  giving  the  exact  dual  price, 

,  the  stationary 


zqz 


rzqz 


\  r1qj  )  r 

we  prove  that  (1)  if  q  >  max  \ — - — L—  >  =  - ; - 

=  la  +  r.  I  a  +  r 

l<J*n  '  J> 

program  (y^Ct)  =  0  ,  1  <  i  <  n)  is  optimal;  (2)  if  q  <  ~  -  , 

/  rtqt  \ 

we  build  M  (in  fact,  any  M  s.t.  — — - =  — — - )  .  If  the 

^  \  t  a  +  rt  a  +  rj 

utility  function  is  nonlinear,  life  gets  complicated. 

To  begin  with,  we  do  not  know  whether  a  right-differentiable 

(see  Perold  [5])  optimal  solution  exists.^  Secondly,  we  do  not  know 

2 

whether  the  dual  price  exists.  To  simplify  the  model,  we  restrict 
the  utility  functions  to  those  "well-behaved"  differentiable  increasing 
functions  such  that  there  exist  right-differentiable  optimal  solutions 


Since  our  model  is  an  economic  model,  we  would  like  an  optimal  solution 
which  is  right-differentiable  rather  than  just  Lebesque-measurable . 

In  1968,  Hanson  [3]  proved  the  strong  duality  of  the  similar  model  in 
the  finite  horizon  case. 
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and  the  corresponding  dual  prices.  Under  this  assumption,  we  prove 

rjtqe 

that  (1)  q  >  —  ■  —  is  still  the  sufficient  and  necessary  conditions 

for  the  existence  of  an  optimal  stationary  program;  (2)  if  the  condition 
of  (1)  is  not  met,  we  can  prove  an  asymptotic  result,  i.e.,  as  t  -*■  00  , 
the  optimal  solution  has  the  same  behavior  as  the  linear  case. 

It  is  difficult  to  give  a  simple  characterization  of  the  optimal 
solution  of  a  nonlinear  utility  function  because  we  have  examples  in 
which  we  switch  building  machines  (Chapter  4,  Example  1),  or  build 
some  machine  Mj  in  time  [T^,T2]  but  later  never  use  M  . 

Even  in  the  one  machine  case,  we  might  have  x(t)  =0  in  the 
first  interval,  x(t)  >0  in  the  second  interval,  and  x(t)  =  0 
in  the  third  interval  (Chapter  3,  Example  2). 

In  the  following  we  prove  that  by  manipulating  the  model  we  can 
make  some  assumptions  without  losing  generality. 


Assumption  1:  q.  >  q„  >  . . .  >  q  ,  r,  <  r„  <  . . .  <  r 
- -  12  n  1  2  n 

If  q^  =  q j  and  r^  >  r_.  ,  apparently  we  never  build  (for 

has  the  same  output,  but  larger  r  ) . 


(i) 

(ii) 


If  k.  =  0  ,  then  we.  discard  M.  . 

3  3 

If  kj  >  0  ,  we  define  a  new  problem  with  n  -  1  machines 

(without  M.)  and  the  initial  stocks  k  given  by 
J  s 


k.  =  k.  +  k.  ,  k  =k 
i  i  3  s  s 


l<s<n,s#i,j  . 

It's  easy  to  see  that  the  new  problem  is  in  fact  the  same 
as  the  old  one. 


3 

It  is  believed  that  for  all  "usual"  concave  functions,  these  properties 
are  true.  Since  our  model  is  a  simple  economic  model,  there  should 
exist  the  dual  price  and  a  well-behaved  optimal  solution. 
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■* 


Hence,  without  losing  generality  we  can  assume  , 


if  i  ^  j  . 


Now  we  rearrange  the  machines  in  order  of  decreasing  output. 


Assumption  2:  K  =  \  k.  <  1 

i=l  1 


n  j  j+1 

If  l  k  >  1  ,  let  l  k  <  1  ,  l  k  >  1  . 

J  _  -i 


We  will  show 


that  the  general  problem  is  in  fact  equivalent  to  this  special  case. 


(1)  We  never  build  M  ,  s> j+1  /  j+1 

(for  I  k  >  1  and  q  >  q_  >  . .  .  >  q  J 

,SU)=0  ,  s  >  j  +  2  VtjO  .  V  1-X  l’  12  ”/ 

(2)  By  (1)  we  discard  Ms  ,  s  >  j  +  2  . 

(3)  Consider  a  new  problem  with  machines  ...,  M..  and  q 

replaced  by  q^+^  . 

By  (2)  and  (3),  it  is  clear  that  the  new  problem  is  essentially  the  same 

as  the  old  one,  but  |  k.  <  1  for  the  new  problem. 

i=l 

Before  ending  this  chapter,  we  prove  two  theorems  which  play  the 
key  role  in  the  following  chapters. 


Theorem  1-2: 


(1)  x(t)  +  J  (y  (t)  +  z.(t))  =  1  for  all  t  (full  employment). 

i-1  1 

(2)  There  always  exists  the  dual  price  w^Ct)  =  je  at'*qi*vPCt)  -w(t)J  + 
1  <  i  <  n 


which  satisfies  the  conditions  of  Theorem  1-1, 
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Proof : 

n 

(1)  If  x(t)  +  l  (y.(t)  +  z  (t))  -  P(t)  <  1 

i-1 

since  x(t)  has  output  q  ,  we  can  increase  x(t) 
by  1  -  p(t)  to  produce  more  output,  contradiction. 

(2)  w  (t)  >  0  and  w(t)  +  w^Ct)  >  e  at*qi*^(t) 
implies  w^t)  >  je  at*qi*^(t)  -  w(t)j+  . 

Define: 


k±(t) 


■  -  -  I 


yi(s)ds 


If  >  0  ,  Case  i:  z^(t)  <  k^(t) 

by  complementary  slackness  w^(t)  *  0  = 

[e  at-qi*iKt)  -  w(t)J  +  • 

Case  ii:  z.(t)  =  k. (t) 
i  i 

w(t)  +  w^(t)  =  e  at,q^*i^(t)  implies 
wi(t)  =  £e  at,qi’^(t)  -  w(t)J  +  • 

If  k^  *  0  ,  Case  i:  there  exists  T  >  0  ,  such  that  k^(t)  »  0 

for  t  <  T  and  k^(t)  >  0  for  t  >  T  • 
w±(t)  =  at*qi*iJ'(t)  -  w(t)J  +  Vt  >  T  . 

Define  w^(t)  *  £e  at*q^*il)(t)  -  w(t)J  +  for  t<T  . 
00 

w(t)  >  f  w^(s)ds  (w  (t)  is  the  dual  price) 

for  t  <  T 

00  A 

>  ri  /  wi(s)ds  (w  (s)  >  ir  (s»  • 


! 

i 


10 


y^(t)  =  0  for  t  <  T  (k^(t)  =  0)  implies 
the  complementary  slackness  is  also  satisfied 
for  w^Ct)  . 

Case  ii:  if  k^(t)  =  0  for  all  t 
similar  proof  as  above. 

Thus  there  exists  an  optimal  price  w^(t)  *  f"e  at,qi*iHt)  -  w(t)l+B 


Remark : 

(1)  If  k^  =  0  ,  w^(t)  need  not  be  unique. 

[““Ctt 

e  •q^'Kt)  -  w(t) 


A  solution  X(t)  =  (x(t)  .y^t)  .z^t))  €  TR+  is  called  stationary 


if 

x(t)  « 

1  -  k  ,  y^t)  *  0  ,  zi(t)  *  ^  | 

k  *  l  ki 
l  i-1  1 

J  for  all  t 

1  < 

i  <  n  . 

.  ,  riqi 

Let  max  - ; -  *  v  . 

l<i<n  x 

Theorem  1-3: 

q  >  v  is  the  sufficient  and  necessary  condition  for  the  existence 
of  an  optimal  stationary  program. 


Proof : 

If  q  >  v,  the  stationary  program  is  feasible  and  c(t)  = 
n 

q*(l-k)  +  £  k  *q  =  constant  implies  ip ( t )  =  constant  =  c  >  0  . 

i-1  1 

Define:  w(t)  =  e  *q*>Kt)  *  e  ’q’C  and  w^(t)  =  e  •  (q^  -  qH(t)  * 

-at  .  . 

e  *(qi  -  q)’c  . 

It  is  easy  to  see  that  if  we  can  prove  d^(t)  >0  1  <  i  <  n 

then  the  stationary  program  is  optimal. 


d^(c)  = 


> 


-at 

e  *  q*  c 


-  r. 
1 


oo 


-as 

e 


(qi 


q) "Cds 


-at. 

6  -  >C  [«q  -  ri(qi  -  q)] 


aq 


ri(qi"q) 


is  equivalent  to  q  > 


-MU 

°  *  ri  / 


The  other  direction  is  similar.  (Here  we  use  the  assumption  of  the 
existence  of  the  dual  price.)® 


12 


4 


CHAPTER  II 


THE  LINEAR  UTILITY  FUNCTION 


To  develop  better  understanding  of  the  general  concave  utility 
function,  we  start  with  the  linear  utility  function.  There  are  only 
two  kinds  of  the  optimal  program  for  the  linear  utility  function: 
one  is  never  building  any  machine,  the  other  is  building  only  one 
machine. 

For  completeness,  we  list  the  stationary  program  in  the  following. 


il.  Stationary  Program 


Theorem  2-1: 

q  >  v  is  the  sufficient  and  necessary  condition  for  the  existence 


of  an  optimal  stationary  program. 
From  now  on,  assume  q  <  v  . 


§2.  Nonstationary  Program 


Machine  j  is  called  best,  if  + =  v  .  I  5  (i  |  <1^  >  v  , 

N  2 

1  <  i  <  n}  =  (1,2,  ...,  N}  ,  K  *  £  k^  .  Machine  i  is  called  good, 

if  i  €  I  . 

For  any  best  machine  j  ,  the  following  program  is  called  the 
best  program  with  respect  to  j  :  x(t)  =  0  ,  y^(t)  “0  i  i  j  , 

-  "V 

y  (t)  -  (l-k)e  2  ,  z^t)  -  k.  i  £  I  -  {j}  ,  Zj  (t)  -  k^  + 


(1-k) 


|l-e  ^  )  ,  z^Ct)  *0  r  i  I  .  (This  means  that  all  the  good 


machines  are  fully  utilized,  then  the  rest  of  the  labor  is  used  to 


build  machine  j  . ) 
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Theorem  2-2: 


The  best  program  with  respect  to  j  is  optimal. 


Proof : 


c(t)  »  £  q.*z  (t)  ,  tii (t )  a  constant  =  a  >  0  (because  U  is  linear). 

i=l  1 


Define: 


j  r .  q . 

w(t)  =  e  aC-[q’a  +  s]  =  e  t  • — j- a  ,  S 

a  +  r . 


-  •] 


a  >  0 


/  \  -at 
w.  (t)  *  e 

L  1 


s .  \  -at 

w  (t)  =  e 


d j  (t)  =  e 


(q. - ^  I  *a  if  i  €  I 

1  a  +  rj/ 

;-(qi  '^r)+*a  =  0  if  i€  1  • 

Vi  f  -as  I"  riqi  1 

•a*  — - r,  I  e  -a-  q . - ± 

a  +  r.  jj  *  +  r j  J 


•a  =  0  if  ifl  . 


ds  *  0 


OD 

i  G  I  —  { j  }  ,  d  (t)  «  e  at»a*  — - r  .  [  e  as*a*  (q . - j;  \ 

J  i  a  +  r  ^  x  J  y1!  a  +  r ^  J 


-at 

e  *a- 


--li  - l&L 1  >  0 

a  a+r.  a+r.l* 

L  J  ij 


i  £  I  ,  d^(t)  *  w(t)  -  0  >  0  . 


If  i  G  I  ,  zi(t)  *  k±(t)  ;  if  i  i  1  ,  z..(t)  *  0  . 


The  complementary  slackness  is  also  satisfied 
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CHAPTER  III 

GENERAL  CONCAVE  UTILITY  FUNCTION  -  ONE  MACHINE  CASE 


For  the  general  concave  utility,  to  get  deeper  insight  about 
the  structure  of  the  many  machines,  we  begin  with  one  machine  case. 

In  the  beginning,  we  derive  some  simple  properties.  Later  we  prove 
that  if  the  initial  stocks  are  sufficiently  large,  we  don't  use  labor 
alone  to  produce  output.  If  the  utility  function  is  quadratic,  we 
have  a  simple  optimal  solution.  Otherwise,  we  have  an  example  with 
a  non-simple  solution.  We  also  give  an  algorithm  to  solve  the  general 
problem.  By  scaling,  we  can  assume  q  =  1  without  losing  generality. 

Because  of  the  simple  structure,  we  rewrite  the  primal  and  dual 
feasibilities  in  terms  of  the  following  simplified  notation: 


x(t)  «-  x(tj  ,  y (t)  «-  yx(t)  ,  z(t)  -  z1(t)  ,  r  r^  ,  q  «-  q1 


z(t)  <  r  I  y(s)ds 


primal  feasibility: 


I 


x(t)  +  y (t)  +  z ( t )  *  1 


x(t)  ,  y (t)  ,  z(t)  >  0 


at 


w(t)  >  e  *  ip  ( t ) 


dual  feasibility: 


OO 

Jv 


w(t)  >  r  I  w  (s)ds 


w(t)  +  w^(t)  >  e  at*q*<(>(t) 


w(t)  ,  w^t)  >  0  . 
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For  completeness,  we  list  the  stationary  program  in  the  following. 

11.  Stationary  Program 
Theorem  3-1: 

1  >  — ^ —  is  the  sufficient  and  necessary  condition  for  the 
=  a  +  r 

existence  of  an  optimal  stationary  program® 

From  now  on,  assume  1  <  — ^ —  . 

a  +  r 

§2.  Nonstationary  Program 

We  begin  with  some  simple  properties. 

Property  1: 

y(t)  >  0  ,  for  all  t^  . 

Proof : 

If  there  exists  an  interval  (T,T  +  e)  such  that  y(t)  =  0  for 

t  €  (T,T  +  e)  ,  then  y(t)  =  0  for  all  t  >  T  ,  which  by  stationary 

property  implies  1  >  — —  .  Contradiction  to  1  <  — ^ —  I 
^  r  =  a  +  r  a  +  r 


Corollary : 

00 

w(t)  -  r  /  w1(s)ds  =  0  for  all  t  ■ 


We  disregard  those  isolated  time  points.  When  we  say  y(t)  >  0  for 
all  t  ,  we  mean  there  is  no  interval  such  that  y(t)  =  0  on  that 
whole  interval. 
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Property  2: 


k(t)  =  kg  +  r  /  y(s)ds  =  z(t)  (fully  utilize  the  machine), 


Proof : 


By  contradiction.  If  not  true, 


Case  i:  there  exists  T  >  0  such  that  z(t)  <  k(t)  for  all  t>T 

w^(t)  =  0  (complementary  slackness)  implies  w(t)  =  0  . 
w(t)  >  e  at*i^(t)  implies  i|)(t)  =  0  ,  contradiction. 


Case  ii:  there  exists  such  that  z(t)  <  k(t)  for 

t  G  (T^^)  and  z(t)  =  k(t)  for  t  G  (T2>T2  +  e)  . 

C(T  )  =  x(Tl)  +q«*(Tx)  «  0  +  i.Z(T1)  <  x(T2)  +  q»z(T2)  = 
c(T2)  implies  iKT^)  >  i|)(T2)  • 

00  00 

0  =  w(T1 )  -  r  /  w  (s)ds  *  w(T  )  -  r  /  w  (s)ds  (w  (t)  =*  0 
1  X  1  1  x  1  1 

1  2  t  G  (T  ,T2)) 

-  w^)  -  w(T2)  • 

-aTl  - 

0  <  w(T  )  -  e  •q*'HT1)  .  (w1(T]_)  =  0) 

"aT2  - 

w(T2)  <  e  •q*ii/(T2)  •  (*(T2)  >  0) 

-ot^2  -  _0t^l  - 

From  the  above  three  equations,  we  have  e  •q,<J>(T2)  1  e  •q’vKT^)  •, 

contradiction  to  <  T2  and  ^(T^)  >  i'(T2)  B 

Corollary ; 

k(t)  <  1  for  all  t  .  (We  never  accumulate  to  1  unit  of  machine.) 


Proof : 


The  maximum  amount  of  machine  we  can  have  in  an  optimal  solution 


is  given  by  the  following  program:  x(t)  ■  0  ,  y(t)  *  l-k(t)  , 
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z(t)  *  k(t)  .  k(t)  =  r  J  [l-k(s)]ds  +  k^  ,  which  implies  k(t) 
1  -  (l-kQ)e  rt  ,  thus  k(t)  <  1  for  all  t  ■ 


Remark : 


Property  2  does  not  hold  in  the  many  machines  case. 


Property  3: 


w(t)  is  continuous. 


Proof : 


w(t)  *■  r  /  w  (s)ds  ■ 
t 

Property  A: 

<Kt)  is  continuous. 


Proof : 


By  Property  2  and  <Kt)  =  U'(x(t)  +  q*z(t))  ,  if  we  can  prove 

for  any  given  T  >  0  ,  a  sequence  tn  -►  T  such  that  xCt^)  x 

we  have  ^(t  )  -*■  vp (T)  ,  then  ij/(t)  is  continuous, 
n 

Case  i:  x(T)  *  0  .  If  x(t  )  ->  x  =  0  ,  apparently  ij/(t  )  -*•  ’^(T) 

n  n 

If  x(t  )  -*■  x  >  0  ,  then  lim  c(t  )  >  c(T)  and 
n  n  = 

n-H» 

limii»(t  )  <  iKT)  . 
n  = 

n-*» 

By  slackness,  e  at,iJ/(t  )  =  w(t  )  -*■  w(T)  >  e  at*iJj(T)  . 

n  n  “ 

Combining  the  above  two  equations,  we  have  ip (t n)  -*■  <l>( T) 

Case  ii:  x(T)  >  0  .  If  xCt^)  >  0  >  same  proof  as  above. 

If  x(t  )  *  0  for  all  n  ,  lim  c(t  )  <  c(T)  and 
n  n  ■ 

n-x* 


4 
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lim  <|>(tn)  >  i|)(T)  . 
n-+“ 

e  at,4'(tn)  5  w(tn)  — 1 -  w(T)  =  e  at;*^(T)  . 

Combining  the  above  two  equation,  we  have  ’Htn)  -*  i>(T)B 
Corollary  1: 

If  u(x)  is  strictly  concave,  then  (1)  c(t)  is  continuous; 

(2)  x(t)  ,  y(t)  are  continuous. 

Proof : 

(1)  If  c(t)  is  not  continuous,  then  4>(t)  is  not  continuous, 
contradiction. 

(2)  c(t)  =  x(t)  4-  q • 2  ( t )  .  For  c(t)  and  z(t)  continuous, 
x(t)  is  continuous.  y(t)  =  1  -  x(t)  -  z(t)  implies  y(t) 
is  continuous  tooB 

Corollary  2: 

w^(t)  is  continuous. 

Proof : 

w^(t)  =*  [•-  •q’ip(t)  -  w(t)J+  .  Since  4i(t)  and  w(t)  are 
both  continuous,  w^(t)  is  continuous  tooB 

Property  5: 

If  x(t)  >  0  ,  y(t)  >  0  ,  z(t)  >  0  ,  then  iKt)  =  c*e^a 
c  >  0  ,  t  S  (T  ,t2)  . 


Proof : 


The  dual  equations  are:  w(t)  =  e  at*<Ht)  ,  v^(t)  =  e  •(q-l)i|/(t)  » 

w(t)  =  r  /  (s)ds  .  The  solution  is  >P(t)  =  c*e^a  r^q  ^  .  c  >  OB 
t 

Corollary  1: 

If  u'(q)  >  0  and  x(t)  >  0  ,  y(t)  >  0  ,  z(t)  >  0  ,  then 
<|>(t)  <  6  <  0  . 

Proof : 

ii(t)  =  [a  -  r(q  -  l)]'Kt)  <  U  ’  (q)  [a  -  r  (q  -  1)  ]  =  B  <  OB 
Corollary  2: 

If  tp(t )  =  constant  for  t  e  (T,T  +  e)  ,  then  x(t)  *  0  for 
t  G  (T,T  +  e)  B 

Corollary  3: 

c(t)  is  increasing  in  • 

Proof : 

i(t)  =  c-[a-r(i-l)]-e[a"r(q"1)lt  <  0  ,  so  «|i(t)  is  decreasing  in 
t  .  Since  U' (x)  is  decreasing  in  x,  c(t)  is  increasing  in 

Property  6: 

If  the  utility  function  is  strictly  concave,  then  c(t)  is  a 
strictly  increasing  function. 

Proof : 

If  there  exist  T^,  T2  <  T2  such  that  c(T^)  >  c(T2)  , 

bv  Property  4  there  must  exist  T  ,  T  G  such  that 
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c(T)  =  max  c(t)  . 

tG[T1,T2] 

If  x(T)  >  0  ,  by  Property  5  c(t)  is  strictly  increasing  in 

(T-e,T  +  e)  ,  for  e  small  enough,  contradiction  to 

c(T)  =  max  c(t)  . 

te[T1,T2] 

If  x(T)  =  0  ,  by  Property  2  c(t)  is  strictly  increasing  in 
[T,T  +  e)  ,  for  e  small  enough,  contradiction  ■ 

In  the  following,  we  study  the  asymptotic  behavior. 

Theorem  3-2: 

If  the  utility  function  is  nonsaturate  (U'(q)  >  0)  ,  then  for 
t  sufficiently  large,  x(t)  =  0  . 

Before  proving  this  theorem,  we  need  the  following  lemmas. 

Lemma  1 : 

If  the  utility  function  is  nonsaturate,  k^  is  the  initial  stock 
and  u'(q-k0)  <  U*  (q)  ♦  -  ^"r  .  Then  x(t)  =  0  ,  y(t)  =  (l-kQ)e  rt  , 
z(t)  =  1  -  (1  -  k^)e  rt  is  optimal. 

Proof : 

Define 

(  w ( t )  =  e  at>  [i|>(t)  +  s(t)  ] 
jw^t)  =  e  at  [(q  -  l)<l»(t>  -  s  ( t )  ] 

oo 

where  s(t)  =  +  rq  f  e  ^a+r)x. ^ (x)dx» e  a+r^t  . 

t 
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00 

I 


w^(t)  =  e""at*q*tHt)  -  rq  |  e"^ai+r)xip(x)dx»e ^a+r^ C 


ao 

>  e-at,q*iJj(t)  -  rq-^(t)  J  e“  (a+r)xdx- e (a+r }  C  (v(t)  is  decreasing) 


-at  -  s  a  +  r-  r.„ 

=  e  *q*^(t)  • - : - >  0  . 


a  +  r 


Apparently,  w(t)  >  0  too. 

00 

By  calculation,  w(t)  “  r/w,  (s)ds  for  all  t  ,  which  implies 

t 

the  complementary  slackness  is  satisfied. 

If  we  can  show  w(t)  >  e_01l:*^(t)  ,  then  the  dual  feasibility  is 

also  satisfied,  thus  optimal. 

U'  (q*kQ)  >  >  U'  (q) 

0O 

,  -  f  - (a+r)x . ,  (r+a) t 

s(t)  =  -<P(C)  +  rq  I  e  ^(x)dx-e 

t 

>  -U '  (q •  kQ)  +  >  0 


implies 


w(t)  >  e  aC*iii(t)  ■ 


Lemma  2 : 

k(t)  -*•  1  for  t  sufficiently  large. 


Proof: 


Since  k(t)  is  increasing  and  bounded,  k(t)  -*■  K  ,  y(t)  -*■  0 


as  t  -*■  °° 


i 
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If  k  <  1  ,  as  t  ,  x(t)  =  1  -  y  (t)  -  z  (t )  =  l-k(t)-y(t)  ■+ 

1  -  k  >  0  .  By  Property  5  ijj(t)  -*•  0  ,  contradiction.  Thus  k(t)  -*  1 
for  t  sufficiently  large  ■ 

Now  we  are  ready  to  prove  the  theorem. 

Proof : 

a r  >  1  and  U'  (q)  >  0  imply  the  existence  of  k  <  1  such  that 
U'  (q’k)  <  U'  (5)  • 

By  Lemma  2,  there  exists  T  >  0  such  that  k(T)  >  k  . 

Now  by  Lemma  1,  for  t  sufficiently  large,  we  have  x(t)  =  OB 

In  the  next  section,  we  give  a  general  algorithm  to  solve  the 
one  machine  problem  completely.  This  algorithm  comprises  of  solving 
two  subproblems  (one  with  three  activities,  the  other  with  two 
activities)  backward  by  turns.  It  turns  out  that  we  can  partition  the 
machine  stock  into  disjoint  intervals  such  that  on  each  interval 
either  two  activities  or  three  activities  are  optimal,  and  alternately. 
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PROBLEM  I  (k) 

(1)  Objective:  To  find  the  largest  interval  [k,k]  such  that 
x(t)  >  0  ,  y(t)  >  0  ,  z(t)  >0  is  optimal  if  the 
machine  stock  is  between  [k,k]  . 

(2)  This  method  is  similar  to  the  dual  simplex  method.  By  maintaining 
the  dual  feasibility  and  complementary  slackness,  we  try  to  find 
the  largest  interval  such  that  the  primal  feasibility  is  also 
satisfied. 

0 

(3)  z(t)  =  k  -  r  J  y(s)ds  t  <  0 

t 

0 

c(t)  =  l-y(t)-z(t)+q,z(t)  =  l-k  +  qk-y(t)-r(q-l)  f  y(s)ds  . 

t 

Step  1:  Solve  equation  U'Ck'qj-e^  r<"^  =  U'(c(t))  with  boundary 

condition  y(0)  =  1-k  . 

Step  2:  Compute  z(t)  . 

Find  T  (T  <  0)  such  that  z(T)  =  k^  .  (T  always  exists, 
for  as  T  -*■  -<*>  ,  e r ^  •+  +■»  implies  the  equation  in 

Step  1  has  no  solution.) 

Step  3:  If  for  all  t  S  [T,0)  ,  0  <  y(t)  +  z(t)  <  1  ,  y(t)  >  0  ,  z(t)  >0 
Let  k  ■*-  k^  ,  A  -T  .  Return. 

Otherwise,  go  to  Step  4. 

Step  4:  Find  smallest  T  (T  <  T)  ,  such  that  for  t  €  (T,0) 

0  <  y (t)  +  z(t)  <  1  ,  y(t)  >  0  ,  z(t)  >  0  . 

Let  k  *■  z(T)  ,  A  ■*-  -T  .  Return. 
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PROBLEM  II  (k) 


(1)  Objective:  To  find  the  largest  interval  [k,k]  such  that 
x(t)  =  0  ,  y(t)  >  0  ,  2 ( t )  >0  is  optimal  if  the  machine 
stock  is  between  [k,k]  . 

(2)  This  method  is  similar  to  the  simplex  method.  By  maintaining 
the  primal  feasibility  and  complementary  slackness,  we  try  to 
find  the  largest  interval  such  that  the  dual  feasibility  is 
also  satisfied. 

(3)  x  ( t )  -  0  ,  y(t)  =  (1  -  k)e_rC  ,  z(t)  =  1  -  (l-k)e~rt  , 
c ( t )  =  q [ 1  -  (1  -  k)e  rt]  . 

s(t)  =  -U'  (c (t) )  +  Jjrq  J  e  ^r+a^ S *U  '  (c (s)  )ds  +  U' (q-k)J  •e^r+a^t  . 

Remark:  s(t)  is  the  solution  of  the  following  integral  equation  with 

boundary  condition  s(0)  =  0  . 

00 

e_at • [U ' (c (t) )  +  s(t)]  -  r  /  e~ax [ (q  -  1)U' (c(x))  -s(x)]dx  . 

t 

Step  1:  Find  T  (T  <  0)  such  that  kQ  =  l-(l-k)e_rt  =  z(T)  . 

(T  always  exists,  for  z(T)  -*■-<*>  as  T  -°°  . ) 

Step  2:  If  for  all  t  G  [T,0)  ,  s(t)  >  0  . 

Let  k  *■  k^  ,  A  -T  ,  return. 

Otherwise,  go  to  Step  3. 

Step  3:  Find  smallest  T  (T  <  T)  such  that  s(t)  >  0  for  t  G  [T,0) 

Let  k  •»-  z(T)  ,  A  «-  -T  .  Return. 
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ALGORITHM 

Initialize:  Find  k  decided  from  Theorem  3-2. 
k^-*-k,  i-*-l  ,  k  «-  k^  • 

Step  1:  Solve  Problem  I  (k)  . 
i  «-  i  +  1  . 

x1(t)  x ( t )  ,  y1(t)  +■  y (t )  ,  z 1  ( t )  z(t)  ,  k^  k  ,  A^  •*-  A  . 
If  k.  *  kp  ,  stop. 

Or  else,  k  k  ,  and  go  to  Step  2. 

Step  2:  Solve  Problem  II  (k)  . 
i  i  +  1  . 

x1(t)  0  ,  yX(t)  *-  y (t)  ,  zX(t)  *■  z(t)  ,  k^  -<-  k  ,  A^  A  . 

If  ki  *  kQ  ,  stop. 

Or  else,  k  +•  k  ,  and  go  to  Step  1. 

To  find  the  optimal  solution,  we  have  to  reverse  the  order  of  the 
indices.  Let  N  +  l  be  the  last  index. 


old  indices -*-k. 


»i  Vl  “n 


k. 

l 


k.  -  1 

l 


\w+mmu-bH  f 


new  indices -*-k. 


Vl-i  N+2-i  kN+2-i 


kl=k  A, 


}//■/■/////////! 


kXT  N+l  1 

N 


Vi-i  •  2 : 1  i S  +  1 
Vw  • 1 ; 1 : N+1 


i  N+2-i .  .  i.  .  N+2-i .  .  i.  .  N+2-i,  . 

x  -^X  (t)  ,  y  (t)«-y  (t)  ,  z  (t)  •*-  z  (t)  , 

2  <  i  <  N  +  l  . 
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Define  T. 

i 


T  A .  ,  1  <  i  <  N 

J-l  J  =  = 


TQ  =  0  .  Then 


(1)  x1(t)  ,  yi(t)  ,  zi(t)  is  optimal  for  t  S  1  a  i  =  n  ' 

(2)  x(t)  =  0  ,  y (t)  =  (l-k)e'rt  ,  z(t)  =  l-(l-k)e“rt  is  optimal 

for  t  >  T  . 

=  n 
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§3.  Quadratic  Utility  Function 

7 

(M  —  x ) 

When  the  utility  function  is  quadratic,  U(x)  =  -  - j M 

we  have  a  simple  optimal  solution.  First  we  would  like  to  compute 


k  . 


=  M  -  q  +  q(l  -  k)e 


-rt 


s(t)  =  -<p(t)  4-  rq  J"  e  (r+a) s . ^ (s)ds •  e 
t 


=  r (q  -  1)  - 
a  +  r 


"I  _  ot  -  r(q  -  1)  +  r 


(M  -  q) 


a  +  2r 


q* (1  -  k)e 


-rt 


Case  i:  M  >  q 


If  a  -  r  (q  -  1)  +  r  <  0  ,  then  k  =  0  . 

If  a-r(q-l)  +  r  >  0  ,  let  k  satisfy  r p — —  (M  -  q)  - 

ot  T  r 

- - r  qCl  -  it)  *  0  ,  then  k  =  max  {0,k}  . 

a  +  2r  M 


Case  ii:  M  =  q 

If  a-r(q-l)  +  r  <  0  ,  then  k  =  0  . 

If  a-r(q-l)  +  r  >  0  ,  then  k  =  1  .  (By  Property  2,  this  means 
we  never  reach  this  situation.) 


Remark: 

a  -  r(q-l)  +  r  <  0  is  not  a  sufficient  condition  for  k  =  0 
in  a  general  concave  utility  function.  If  k  =  0  ,  then  we  have 
x(t)  *  0  for  all  t  .  If  k  >  0  ,  we  would  like  to  find  the  optimal 
program  by  using  Algorithm. 


Solve  Problem  I  (k)  : 


II  V 
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'i'(t)  =  M  -  1  +  k  -  q*k  +  y(t)  +  r(q  -  1) 


j  y(s)ds 


t  <  0  . 


Solve  U' (k*q)*e^a-r(q_1) ]t  =  i j/(t)  with  y(0)  =  1  -  k 


equation 


r(q  - 11 


a  +  r 


(M  -  q)  -  ?  r(q  -  1)  4  r  - 
4  a  +  2r 


q(l  -  k) 


y(t)  ,  we  get 


Using  the 
0  to  simplify 


y  (t)  -r(q  -  1)  +r]2  .  er(q-l)t  t  (M  -  q'k)  [a  -  r  (q  -1)1  e[q-r(q-l)]t 

[a  -  2r(q  -  1)  ]  (2r  +  a)  a  -  2r  (q  -  1) 

Fact  1: 

y(t)  is  decreasing  and  y(t)  >  0  for  all  t  <  0  . 

Proof : 

a  -  r(q  -  1)  <  0  implies  y(t)  <  0  ,  thus  y(t)  is  decreasing. 

Also  v(0)  *  0  ,  thus  y(t)  >  0  for  t  <  OB 

Fact  2; 

y(t)  +  2 ( t )  is  a  concave  function. 

Proof : 

d2 

^2  [y(t)  +  z(t)J  =  dt  +  *(0]  <  0  (for  o-r(q-l)  <  0 

and  a-r(q-l)  +  r  >  0)  B 

Fact  3: 

y(t)  +  z(t)  <  1  for  all  t  <  0  . 


Proof : 


y (t)  +  z(t)  is  increasing  as  t  -*•  0  .  (Otherwise,  violate 

y(t)  +  z(t)  <  1  for  y(0)  +  z(0)  =  1  .)  By  Fact  2,  y(t)  +  z(t) 

is  increasing  for  all  t  <  0  ,  thus  y(t)  +  z(t)  <  1  for  all  t  <  01 

From  Fact  3  and  Fact  1,  Algorithm  stops. 

Summarize  the  results  as  follows: 

(1)  If  M  >  q  : 

(i)  If  kQ  >  k  ,  then  x(t)  =  0  ,  y(t)  =  (l-kQ)e  rt  , 

”1T  t 

z(t)  =  1  -  (l-kg)e  is  optimal. 

(ii)  If  kp  <  k  ,  x(t)  >  0  ,  y(t)  >  0  ,  z(t)  >0  is  optimal 

if  t  <  T  ,  where  k(T)  =  k  . 

x(t)  =  0  ,  v(t)  >  0  ,  z (t)  >0  is  optimal  if  t  >  T  . 

(2)  If  M  -  q  : 

(i)  If  a-r(q-l)  +  r  >  0  (k  *  1)  ,  then  x(t)  >  0  , 

y (t)  >  0  ,  z(t)  >  0  is  optimal  for  all  t  . 

(ii)  If  a-r(q-l)  +  r  <  0  (k  =  0)  ,  then  x(t)  =  0  , 

y (t)  =  (1  -  kg)e  rt  ,  z ( t )  =  1  -  (1  -  kg)e  rt  is  optimal. 

Example  1: 

q=2,a*0.9,r=l,kQ=0,  and  the  utility  function  is 

(5  -  x)  ^ 

U (x)  =  -  - ^ -  •  r(q-l)-a  =  0.1  >  0  ,  o-r(q-l)  +  r  =  0.9  >  0  . 

0.1  0.9 

y-q  x  3  -  y~g  x  2  x  (l  -k)  «  0  implies  k  i  0.73  .  We  can  compute 
y(t)  ,  z(t)  ,  x(t)  ,  when  k(t)  <  0.73  ,  using  the  formula  derived 
before ■ 


Let  T  be  such  that  x(T)  +  2*z(T)  =  1  ,  and  z(T)  =  k  . 


Example  2: 

Consider  a  modified  quadratic  utility  function  U(x)  =  4x  -  12 

/  c  _  2 

if  x  <  1  ,  U(x)  =  -  - — if  x  >  1  .  From  Example  1,  if 
k  >  k(t)  >  k  (k(t)  is  the  capital  stock  at  time  t) ,  x(t)  >  0  ; 
if  k(t)  >  k  ,  x(t)  =  0  .  If  k(t)  <  k  ,  the  output  is  located  on 
the  linear  part  of  the  utility  function,  thus  x(t)  =  0  (by  Property  5, 
Corollary  2). 

The  following  pictures  show  the  discontinuous  behavior  of  the 
optimal  solution. 


Remark : 

We  can  remodify  the  utility  function  to  be  strictly  concave  by 
U(x)  =  4x  -  12  -  e*(x-l)2  ,  e  >  0  if  x  <  1  .  As  e  >  0  ,  U"(x)  -  0 
if  x  <  1  .  By  Corollary  1,  Property  5,  x(t)  >  0  for  all  t  ,  where 
k(t)  <  k  ,  is  not  optimal. 
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CHAPTER  IV 

GENERAL  CONCAVE  UTILITY  FUNCTION  -  MANY  MACHINES  CASE 

In  this  chapter  we  generalize  the  idea  of  Chapter  2  and  Chapter  3 
to  obtain  the  asymptotic  result.  Also,  we  give  an  example  which  shows 
the  off-beat  nature  of  this  general  problem.  Again,  we  list  the 
stationary  program  for  completeness. 

§1.  Stationary  Program 
Theorem  4-1: 

r.q. 

1  >  max  - - -  is  the  sufficient  and  necessary  condition 

=  l<i<n  3  +  ri 

for  the  existence  of  an  optimal  stationary  program® 

r.q. 

i  i 

From  now  on,  assume  1  <  max  -  . 

.  .  a  +  r . 
l<i<n  l 

§2.  Nonstationarv  Program 

To  begin  with,  we  prove  some  simple  properties. 

Property  1: 

w(t)  is  continuous. 

Proof : 

We  only  need  to  consider  those  T  >  0  such  that  there  exist 
i  ,  j  (i  i4  j)  and  y^t)  >  0  for  t  €  (T-e,T)  and  y^(t)  >  0 
for  t  G  (T,T  +  e)  . 


■— - i 
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w(T) 

w(t) 


00 


If 

t  G 

(T  -  e  ,T) 

w(t)  =  J 

w^ (s)ds 

OO 

ft 

If 

t  G 

(T,T  +  e) 

w(t)  =  r.  J 

w.  (s)ds 
3 

J  t 

00 

m 

If 

w(T) 

>  r .  I  w. 
XT  1 

(s)ds  ,  then 

as  t 

=  r.  I  w.(s)ds  ,  contradicdon.  Thus 
3  j  J 

is  continuous  ■ 


OO 

,  w(t)  >  r.  f  w. (s)ds 
=  1  J  1 

t 

00 

T  ,  w(t)  -*■  r .  J*  w .  (s)d 
1  T  1 

OO 

w(T)  =  r .  J*  w^(s)ds  and 


s  < 


Remark: 

This  property  gives  us  the  boundary  condition. 

Property  2: 

iKt)  is  continuous. 

Proof : 

If  we  can  prove  that  for  any  sequence  tfl  -*■  T  ,  such  that  x(tn)  "*■  S 
or  there  exists  i  such  that  z^(tn)  -*■  B  and  zg(tn)  =  0  s  <  i-1  , 
we  have  tp ( Cn )  ■+  4i(T)  ,  then  i|)(t)  is  continuous. 

The  proof  is  similar  to  that  of  Property  4,  Chapter  3H 

Corollary : 

If  u(x)  is  strictly  concave,  then  (1)  c(t)  is  continuous; 

(2)  x(t)  and  2^(t)  are  all  continuous  1  <  i  <  nB 

Below  we  study  the  asymptotic  behavior.  We  follow  the  notation 

(  N 

of  Chapter  2,  and  let  L  =  <(k^,  •••»  I  I  ^  <  1  ,  >  0 
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For  any  best  machine  j  ,  k  =  (k^,  ....  k^)  £  L  ,  define  the  following: 


N  /  N  \  /  -r.t\ 

:  ( t ,  k)  =  k.-q.  +  q.\l  -  k.j.(l  -  e  J  ) 


/-(a+r.)s  (a+r.)t 

e  J  U'  (c (s ,k) )ds • e  J 


G  =  <  K 


K  £  L  ,  and  r 


/-(a+rjs 

e  -1  *U '  (c  (s  ,k)  )ds* 


(a+r  ) t 


qN+l‘U,(c(t,k))  >  0 


ao 

J 


e  aS*U' (c (s ,k) )ds*  r 


r .  t 


/-(a+r . ) s 

e  J  *U  '  (c (s , k) )ds • 


e-1  *q.(r.  -r.)  >0  for  i  G  I  -  {j} 
J  J  x  = 


for  all  t  >  0  . 


Given  any  initial  stocks  k^  of  machine  i,  1  <  i  <  n  ,  let 
k  =  (k^,  k^)  ,  and  we  have  the  following  theorem. 


Theorem  4-2: 


If  K  G  G  ,  then  the  best  program  with  respect  to  j  is  optimal. 


If  N  =  n  ,  then  replace  qN+^  by  1  ;  *  implies  s(t,k)  >  0  for  all  t 


The  output  rate  function  is  c(t,k)  .  Define: 


w(t)  =  e_at  • [U ' (c (t  ,k) )  +  s  (t  ,ic)  ] 
w  (t)  =  e~at-[(q.  -l)U'(c(t,k))  -  s(t,k)]+  1  <  i  <  n  • 

If  i  €  I  , 

(q.  -  1)U’ (c(t,k))  -  s(t,k) 

J-(a+r.)s  _  (a+r.)t 

e  3  *U'  (c(s,k))ds*e 

t 

>  q  »U’  (c  (t,k))  -  r~j-  U’(c(t,k))  (U'(c(t,k))  is  decreasing) 

i  a  rj 

>  0  (definition  of  I) 

implies  w^(t)  =  e  ■ [ (q^ ~ 1)U' (c(t,k) )  -  s(t,k)]  . 

If  i  <£  I  i 

(q.  -  l)U'(c(t,k))  -  s(t,k) 

i 

/-(a+r . )s  _  (a+r  )t 

e  3  *U’ (c(s,k))ds*e 

t 

(qi  =  W 

<  0  (definition  of  G) 
implies  w^(t)  *  0  . 

00 

w(t)  *  r  f  w , (s)ds  (by  the  result  in  the  one  machine  case). 


If  i  €  I  , 


w(t) 


wi(s)ds  =  w(t) 


>  0  . 


If  i  €  I  , 


w(t) 


00 

-  r.  w. 

J  1 


(s)ds 


00 

/ 


e  as*U' (c (s,k) )ds* r 


ao 


- (a+r . )s 


•U ' (c (s ,k) )ds*q  (r .  - 


3  3 


>  0  (definition  of  G)  . 


Complementary  slackness  is  also  satisfied.  Thus  the  best  program 
with  respect  to  j  is  optimal® 


Let  a 


N  /  N  \ 

■  j,  Vi +  b  ■ b  ■  M1  - 1  h)  • 


then  c(t,k)  = 


-r .  t 
3 


a  -  b*e  J  ,  U'(a)  <  U'(c(t,k))  <  U'(a-b)  . 


Corollary  1: 


If 


/ 


U' (a  -  b) 


q.  (r  .  -  r . ) *a 
11 _ ] _  1 


r  .q . 

U '  (a)  — -1— 4 -  ,  U '  (a)  , 

(a  +  rj)qN+l  (a  +  rj)ri*(qi  "  V 


if  i  £  I  -  (j)  and  r^.  >  r^  , 


fmin/  J 

I  (a  +  r  )r  • (q  -  q  ) 

lu'(a) - H 1 H - —  if  i  £  I 

I  n  ( r  —  r  1  •  r* 


{j}  and  r 


then  the  best  program  with  respect  to  j  is  optimal. 


Proof : 


r.q.  I  e 

22  J 

t 


- (a+r . ) s 


J  -  tt  ’ 


(a+r ,)t 


U' (c(s,k))ds*e 


-  Vi'u'(c(t,k)) 


>  U'  (a)  -  qN+^*U'(a-b)  >  0  (by  assumption) 


If  r.  >  r.  and  i  G  I  -  {j} 
J  1 


CO 

/ 


e  as*U' (c(s,k) )ds*r 


J-(a+r.)s  r.t 

e  2  *U' (c(s,k) )ds*e  J  *q^*(r 


J”U'  (a  -  b)  *r  .  •  (q  .  -  q.)  U'  (a)  *q  •  (r  .  -  r  . )  "] 
>  - i - 1 - —  +  - — 2 - 2 - — 

“l  a  a  +  rj  J 


-at  ,  ^  . 

e  (qt  >  qj) 


>  0  (by  assumption) 


If  r 


i  >  r^  and  i  G  I  -  { j } 


OO 

/ 


e  as*U' (c(s,k))ds 


/-(a+r.)s  _  r.t 

e  2  *U'  (c  (s ,  k)  )ds*  e  *q  *(r 


J~ U  ’  (a)  *ri*  (q^  -  qj  U '  (a  -  b)  •  q..  •  (r  .  "  ri) "] 
*  L  a  +  a  +  r.  J 


-at  ,  . 

e  (q j  >  q±) 


>  0  . 


Thus  K  6  G  and  the  best  program  is  optimal  I 


Corollary  2: 

riqi  riqi 

If  U'(a)  >  0  and  ^—+- ^ . -  >  for  i  #  j  ,  then  when 

N  ^  i 

l  k.  ■*  1  ,  K  €  G  . 
i-1 
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Proof : 


r . q .  r .q  . 

— ,  ~  >  q.,,,  (N  +  l  J  I)  ,  implies  7 — —  ^  -j -  >  1  . 

a  +  rj  hN+1  (a  +  r.)qN+1 

:  i  6  I  -  {]}  and  r^.  >  , 

q.(r.  -  r.)a  -  (a  +  r.)r.(q.  -  q.)  =  r.q.(ct  +  r.)  -  r.q.(a  +  r.) 
J  J  1  J  1  1  J  J  J  1  i  1  j 

(r.q.  r.q.  \ 

— lLl  >  , 

a+r.  a  +  rj’ 


>  0 


q  .  (r  .  -  r .  )a 

implies  7 — ^ 7-— - r-  >  1  . 

K  (a  +  rj)ri(qi  -  q  ) 


If  i  6  I  -  tj)  and  ri  5  rj  * 


(a  +  r.)r.(q,  -  q.)  -  q  -  r.)a  *  rjqj(ct  +  ri)  "  riqi(ct  +  rj)  >  0  * 

(a  +  r  )r  • (q  -  q.) 


implies 


_  LL_L_2i _ 111 

q  .  (r  .  -  r . )a 

J  1  J 


N 


>  1  . 


N 


As  £  k  -*•  1  ,  U'(a)  -*■  U'(a-b)  ;  thus  as  £  k.  -*■  1  ,  Corollary  1 
i-1  1  i-1  1 

is  true,  which  implies  K  G  G  ■ 


Remark: 

If  the  best  machine  is  not  unique,  we  can  use  Taylor  Expansion 
to  get  the  similar  result. 


Lemma  1 : 

As  t  -*■  00  ,  c(t)  -*•  constant,  z^(t)  -*•  constant,  yi(t)  -*■  0  , 


x(t)  constant. 
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Proof : 

Since  k^(t)  is  increasing  and  bounded,  k^(t)  -*■  c^  as  t  ■*  ®  , 

n 

which  implies  y.(t)  -*■  0  ,  £  z.(t)  +  x(t)  -*•  1  as  t  00  . 

1  i=l  1 

Since  q,  >  q„  >  . . .  >  q  >  1  ,  so  x(t)  and  z.(t)  -*■  constant 
i  2.  n  i 

n 

as  t  -*•  03  .  c(t)  =  x(t)  +  \  q.'z.(t)  -*•  constant  as  t  *  B 

i=l  1  1 


Theorem  4-3: 

N 

As  t  -*■<*>  ,  \  k .  (t)  -*■  1  . 

i=l  1 


Proof : 


For  any  t  >  0  ,  there  exist  T,P,,P_,  ...,  P  ,  P  >  0  ,  such  that 

l  /.  n 

n 

x(t)  >  P  ,  z  (t)  >  P.  1  <  i  <  n  and  1  P.  +  P  >  1  -  e  for  all 

i=l 

t  >  T  .  After  time  T  we  can  solve  the  original  problem  in  the 
following  two  steps: 


Step  1: 
Step  2: 


Put  Pi(P)  units  of  labor  to  work  with  machine  i 


Consider  a  new  problem  with  1 


-U  H 


units 


(alone) . 
of 


labor:  let  c(t)  be  the  output  rate  function,  U(x) 
be  the  utility  function,  where  U(c(t))  = 

uH + 1 + ?)  ■ 


As  e  ■*  0  ,  u(c(t))  -*•  constant  for  all  t  ,  thus  the  optimal 
program  for  Step  2  is  the  best  program  with  respect  to  j  ,  which 
implies  that  we  only  build  machine  j  as  t  “  .  Combining  Step  1 


nii  A  I  ■  '  1 
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and  Step  2,  we  find  that  as  t  -*•  00  we  only  build  machine  j  .  From 

the  proof  of  Theorem  4-2,  we  must  have  z^(t)  =  0  i  £  I  as  t  , 

N 

which  implies  £  k  (t)  -*-1  as  t  -*•  °»  ■ 
i=l  i 

Corollary: 

riql  riqi 

If  U'(q, )  >0  ,  —  ^  ■  >  -  —  -  for  i  t  j  ,  then  for  t 

rj  i 

sufficiently  large,  the  best  program  with  respect  to  j  is  optimal ■ 

Property  3: 

ty(t)  is  decreasing. 

Proof : 

By  contradiction.  If  not,  let  (T-e,T)  be  the  last  time  interval 
such  that  >Kt)  is  increasing.  (T  exists,  for  ij>(t)  is  continuous 
and  as  t  -*■  00  the  best  program  is  optimal.) 

There  are  two  possibilities:  x(t)  >0  or  0  <  z^(t)  <  k^(t) 
for  some  i  .  If  x(t)  >  0  and  y  (t)  >  0  ,  t  €  (T-e,T)  , 


-at 


w(t)  =  e  *ijj(t)  =  I  w^(s)ds 


00 

J 


I 


I 


<  r£  |  wj_(s)ds  +  r^(q^  -  1)  *^(T)  |  e  asds 


(Mt)  is  decreasing  for  t  >  T  and  w^(t)  < 


-at 


'l'(t)  •  (q  -  1))  . 


implies  a  <  r^ (a^  -  1)  . 


As  t  -  T_  ,  c~aT*i|)(T)  <  -  4<(T)  *e-aT 

la"r*(qr1)1,: 

But  =  c*e  (by  Property  5,  Chapter  3)  implies 

!p(t)  is  decreasing,  contradiction.  In  the  case  of  0  <  z^(t)  <  k^(t)  , 

the  proof  is  similar® 

Corollary  1; 

If  yi(t)  >  0  then  a  <  r^(q^-l)  • 

Proof : 


e  at*iJ)(t)  <  w(t)  ■ 


Corollary  2: 

If  u(x)  is  strictly  concave,  then  c(t)  is  strictly  increasing® 


§3.  Example 
Example  1; 

The  following  two-machines  problem  shows  that  we  build  different 
machines.  (Time  [0,T)  we  build  machine  2,  time  [T,°°)  we  build 
machine  1.) 

2 

U(x)  =■  -  2 X"  »  a  *  0.9  ,  r^  *  1  ,  *■  30  ,  r^  “  4  ,  ,  q  * 


flql 
a  +  r. 


„  r2q2 
q2  a  +  r„ 


implies  machine  1  is  best,  machine  2  is  good. 


1  -  ~  ’  ‘2 

And  we  can  find  the  exact  dual  price,  using  the  technique  in  Chapter  3, 


such  that  there  exist  T 


,  k  >  0 


1  -  e 


-vT_ 


S  0.0932  and 


-r  (t-T)  -r  (t-T) 

x(t)  =  0  ,  y^t)  =  (l-k)e  ,  z^(t)  =  1  -  k  -  (l-k)e  , 

z2(t)  =  k  ,  y2(t)  =0  is  optimal  for  t  >  T  ;  x(t)  *  0  ,  y^(t)  =  0  , 

-r2t  -r2t 

z^(t)  =  0  ,  y2(t)  *  e  ,  z2(t)  =  1  -  e  is  optimal  for  t  <  T  . 


Example  2: 

This  two  machines  example  shows  that  we  build  machine  2  in  some 


time  interval  (T^,T2)  ,  but  as  t  -*■  00  we  never  use  machine  2. 
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M  =  51  ,  rn  =  1  ,  q1  =  50  ,  k7  =  k0  =  0  ,  a  =  0.9  ,  q9  =  -j— g  > 


r2  =  some  large  number  (decided  later) ,  u(x)  =  - 


(51  -x)‘ 


1  . 


rlql  50  40 


r2q2 


■  r?  ’  TT9  '  q2  -  '  lmI>lles  *2(t>  ■  0  as  c 


(machine  2  is  not  good),  a  -  r^(q^  -  1)  +r^=0.9-49+l<0  , 


-V  -ric 

so  if  we  can  prove  that  x(t)  *  0  ,  y^(t)  =  e  ,  z^(t)  *  1  -  e 


y2(t)  =  0  ,  z2(t)  *  0  is  not  optimal,  then  there  must  exist  some  time 


-r,t 


interval  in  which  we  build  machine  2.  If  x(t)  =  0  ,  y^(t)  =  e  1  , 


"rlC  -at 

z^(t)  *  1  -  e  is  optimal,  then  w2(t)  =  e 


■V  /  ri’i  \ 

-  imrJl  ■ 


("2  (M-’i> 

■  '  r  n 


If 


q2 


rlql  .  n  “  rlql 
a  +  r,  ’  q2  a  +  2r, 


>  0 


and 


then  there  exists 


(’2  -  rrrj)  +  ” 0  • 

/  rlql  \  -rl^  /  rlql  \ 

t  >  o  such  that  h2  -  TTT^J  (M"ql)  +  6  *ql"  ^q2  "  a~  =  0  • 

which  implies  w2(t)  *  0  t  >  T  ,  w2(t)  >0  t  <  T  . 


°o  i  y, 

r2  J  w2(s)ds  ■  r2  j  w2(s)ds  ■  r2*k  where  k  »J  w2(s)ds  >  0 


T 

2 


1 

2 


1 

2 


r„ 


as 


-4*  00 


Contradiction  to 


rlql 

q  -  -4  —  X  -5  <  0 
42  a  +  r 


o 

q2  2r  +  a 


Check: 


20  -  16.3  S  3.7  >  0  . 
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CHAPTER  V 

VARIANT  OF  THE  MODEL 


In  this  chapter  we  introduce  the  depreciation  factor  6  into  the 
model.  Difficulty  arises  here  because  the  capital  stocks  are  no  longer 
monotonic  over  time  in  the  many  machines  case.  For  simplicity,  we 
concentrate  on  the  one  machine  case. 

The  model  with  the  depreciation  factor  5  is: 


CO 

f 


-at 


<P)  max  I  e  -U(x(t))dt  s.t.  A*x(t) 

*0 

x  ( t )  >  0  . 


(s)ds  +  b ( t )  , 


00 

I 


CO 

/-S (s-t) 
e  •  w 


<D)  min  1  w(t)*b(t)dt  s.t.  w(t)A  > 

*0  t 

e  at*VU(x(t))dt  ,  w(t)  >  0  . 


(s) • Bds  + 


In  the  one  machine  case,  if  we  compare  the  depreciation  and  non- 
depreciation  cases,  the  differences  are  the  following  two  equations: 


1 


z(t)  <  r  |  e  S^*y(s)ds  +  k^e 


w(t)  >  r 


00 

f  -6 (s-t) 

J  ‘W1 


(s)ds 


The  following  program  is  called  contraction:  x(t) 
y (t)  -  0  ,  z(t)  *  k0*e~5t  . 


!-k0e 


-6t 
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Theorem  5-1: 


1  >  — ; — ; — r  is  a  necessary  condition  for  the  existence  of  an 
=  a  +  r  +  o 

optimal  contraction  program. 


Proof : 


—  * *  (5 1  “  5 1 

c(t)  =  q'k^-e  +  1  -  k^e  ,  i^(t)  is  increasing. 
Define:  w(t)  =  e  at*iJ/(t)  ,  w^(t)  =  e  °tC(q  —  l)ip(t)  . 


00 

<  w(t)  -  r  ^  e 


<  e  at*^(t)  -  r  (q  -  l)i(j(t)  •e^t*  (  e  ^a+<5^sds 


QO 


(i|i(t)  is  increasing) 


a  o 


implies  a  +  6  -  r(q  -  1)  >  0  ,  1  >  -  *  '+ 


Remark : 


(1)  (*)  is  the  sufficient  and  necessary  condition  for  the 
existence  of  an  optimal  contraction  program. 

(2)  In  the  linear  utility  function  case,  the  above  condition 
is  also  sufficient. 


From  now  on,  assume  1  <  — — ^ — : — r  and  U'(q)  >  0  . 

a  +  r  +  S  M 

In  the  following,  we  prove  an  asymptotic  result  similar  to  the 


nondepreciation  case. 


Lemma  1 : 


If  x(t)  =  0  ,  z(t)  =  r  /  e  5^c  SLy(s)ds  +  k*e  5  ,  x(t)  +  y(t)  + 

0 

6  /  r  ,\  -(r+6) t  _  r  ...  _ 

z(t)  *  1  ,  Chen  y (t)  =  r  ~  6  +  |^r  +  6  "  kJe  ’  (t)  r  +  5 


-(r+6)t 


Proof : 


r  f  e  s^y(s)ds  +  y(t)  = 


_  .  -6t  .  ,  . 

1  -  k*e  ,  implies 


Define: 


»-[r f7-(7fr-K(r+5,t] 

k)  =  -U’(c(t,k))  +  rq  J e_(a+r+5)X'U' (c(x,k))dx*e(a+r+6)t 

t 

k)  =  U’(c(t,k))  -  r  J  e-(c‘+r+6)x-U' (c(x,k))dx*e''a+r+'5)t 

t 

{k  I  0  <  k  <  1  ,  s(t,k)  >  0  ,  9(t,k)  >  0  for  all  t  >  0} 


a  +  r  +  6 


a  +  r  +  5 
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Lemma  2 : 

s(t,k)  is  Che  solution  of  the  following  equations: 
w(t)  =  e  aC,[U'  (c  (t  ,k) )  +  s  ( t ,  k)  ]  ,  w.^  (t)  =  e  at*[(q-l)U'(c(t,k))-s(t,k)], 

CO 

w(t)  =  r  f  e  ^  S  C^*w^(s)ds  . 
t 

Proof : 

It  is  a  straightforward  calculation  ■ 

Theorem  5-2: 

If  k  €  G  ,  then  x(t)  =  0  ,  y(t)  =  f— |  ~+~  ~  kje  ^r+6^t  , 

2(t)  =  7TT  "  (FTT  '  k)e_(r+Mt  is  optimal. 

Proof : 

Define : 

{w(t)  =  e  at*[U' (c(t,k))  +  s (t ,k) ] 
w1(t)  =  e  at’ [ (q  -  1)U' (c(t,k))  -  s(t,k)]+  . 

00  " 

/  /_  |  -(a+r+6)s  ,  ....  ( r+a+6 ) t 

U  (c(t,k))  -  r  I  e  *U  (c(s,k))ds*e 

C  J  + 

=  e  at • q • 9 (t ,k)  =  e  at • ( (q  -  1 )U ' (c (t , k) )  -  s(t,k)]  . 

By  Lemma  2  and  the  definition  of  G  ,  the  rest  of  the  proof  is 
straightforward  I 

Corollary : 

If  k,.  ■+  — 7—7  ,  then  k.  £  G  , 
u  r  +  0  U 


w1(t) 


-at  - 
e  •  q* 
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Proof : 


As  k 


0  r  + 
implies  E  G  ■ 


,  s(t,kQ) 


f  rhi) 


>  0  ,  9(t,kQ) 


f  tH)  > 


Lemma  3 : 


,  -  .  ,  -<5t  ,  r  -<5(t-s)  ,  .  ,  .  _ 

k(t)  =  k  *e  +  r  J  e  *y(s)ds  is  monotonic. 


Proof : 

If  k(t)  is  not  monotonic,  say  increasing  in  (T-e,T)  ,  decreasing 
in  (T,T  +  e)  .  Since  k(t)  is  continuous,  some  moment  right  before  T 
should  have  the  same  capital  stock  as  some  moment  right  after  T  ,  thus 
the  same  behavior.  (See  the  illustration  below.) 


Contradict  to  the  fact  that  k(t)  is  increasing  before  T  and  k(t) 
is  decreasing  after  T  ■ 

Lemma  4 : 

As  t  -*•  00  ,  c(t)  -*•  constant,  <p(C )  -*■  constant. 


Proof : 

As  t  -*■  ®  z(t)  =  k(t)  ■*  constant  (k(t)  is  monotonic  and  bounded); 
y(t)  -*■  constant  (k(t)  -*■  constant); 


x(t)  -*■  constant  (x(t)  +  y(t)  +  z(t)  =  1)  ; 

c(t)  =  x(t)  +  q*z(t)  -*•  constant,  ( c )  -+■  constant  ■ 

Lemma  5 : 

If  x(t)  >  0  ,  y(t)  >  0  ,  z(t)  >  0  ,  then  ip(c)  =  c*e^a+<^ 

Proof : 

Straightforward  ■ 

Lemma  6 : 

As  t-»-”,y(t)-<-8>0. 

Proof : 

By  contradiction.  If  y(t)  -*■  0  as  t  -*■  ®  ,  then  z(t)  ■+  0  , 
x(t)  •*  1  as  t  -*■  «  .  If  y(t)  #0  as  t  -*■  °°  ,  contradiction  to 
Lemma  4  and  Lemma  5.  If  y(t)  =0  as  t  -*■  00  ,  contradiction  to 
Theorem  5-1  B 

From  Lemmas  4,  5  and  6,  we  know  for  t  sufficiently  large, 

x(t)  =  0  .  Thus  k(t)  — 7—7  ,  k(t)  EG  as  t  -*■  00  .  We  state  the 

r  +  0 

above  results  in  the  following  theorem. 

Theorem  5-3: 

(1)  If  k„  <  — 7—7  then  k(t)  is  increasing,  and  for  t 

U  r  +  0 

r 

sufficiently  large  k(t)  ■*  --  —  ,  x(t)  =  0  . 

(2)  If  k„  >  — 7—7  then  k(t)  is  decreasing,  and  for  t 
sufficiently  large  k(t)  -*•  —  ■  ^ ,  x(t)  *  0  B 
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